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Q 1 Abstract 
O 

This work studies the capacity of multipath fading channels. A noncoherent channel 
£N| , model is considered, where neither the transmitter nor the receiver is cognizant of the 

realization of the path gains, but both are cognizant of their statistics. It is shown that if 
the delay spread is large in the sense that the variances of the path gains decay exponentially 
or slower, then capacity is bounded in the signal-to-noise ratio (SNR). For such channels, 
■ capacity does not tend to infinity as the SNR tends to infinity. In contrast, if the variances 

of the path gains decay faster than exponentially, then capacity is unbounded in the SNR. 
It is further demonstrated that if the number of paths is finite, then at high SNR capacity 
grows double-logarithmically with the SNR, and the capacity pre-loglog, defined as the 
limiting ratio of capacity to log log SNR as SNR tends to infinity, is 1 irrespective of the 
^ ■ number of paths. Q 

1 Introduction 

We study the capacity of discrete-time multipath fading channels. In multipath fading channels, 
the transmitted signal propagates along a multitude of paths, and the gains and delays of these 
paths vary over time. In general, the path delays differ from each other, and the receiver thus 
observes a weighted sum of delayed replicas of the transmitted signal, where the weights are 
random. We shall slightly abuse nomenclature and refer to each summand in the received signal 
as a path, and to the corresponding weight as its path gain, even if it is in fact composed of a 
multitude of paths. We consider a noncoherent channel model, where transmitter and receiver 
are cognizant of the statistics of the path gains, but are ignorant of their realization. 

Multipath fading channels arise in wireless communications, where obstacles in the surround- 
ings reflect the transmitted signal and force it to propagate along multiple paths, and where 
relative movements of transmitter, receiver, and obstacles lead to time-variations of the path 
gains and delays. Examples of wireless communication scenarios where the receiver observes typ- 
ically more than one path include radio communications (particularly if the transmitted signal 
is of large bandwidth as, for example, in Ultra- Wideband or in CDMA) and underwater acoustic 
communications. 

The capacity of noncoherent multipath fading channels has been investigated extensively in 
the wideband regime, where the signal-to-noise ratio (SNR) is typically small. It was shown by 
Kennedy that, in the limit as the available bandwidth tends to infinity, the capacity of the fading 
channel is the same as the capacity of the additive white Gaussian noise (AWGN) channel of 
equal received power; see [TJ Sec. 8.6] and references therein. 

To the best of our knowledge, not much is known about the capacity of noncoherent multipath 
fading channels at high SNR. For the special case of noncoherent frequency-flat fading channels 
(where we only have one path), it was shown by Lapidoth & Moser [5] that if the fading process 
is of finite entropy rate, then at high SNR capacity grows double-logarithmically in the SNR. 
This is much slower than the logarithmic growth of the AWGN capacity [3]. 
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In this work, we study the high-SNR behavior of the capacity of noncoherent multipath fading 
channels (where the number of paths is typically greater than one). We demonstrate that the 
capacity of such channels does not merely grow slower with the SNR than the capacity of the 
AWGN channel, but may be even bounded in the SNR. In other words, for such channels the 
capacity does not necessarily tend to infinity as the SNR tends to infinity. 

We derive a necessary and a sufficient condition for the capacity to be bounded in the 
SNR. We show that if the variances of the path gains decay exponentially or slower, then 
capacity is bounded in the SNR. In contrast, if the variances of the path gains decay faster than 
exponentially, then capacity is unbounded in the SNR. We further show that if the number of 
paths is finite, then at high SNR capacity increases double-logarithmically with the SNR, and 
the capacity pre-loglog, defined as the limiting ratio of the capacity to log log SNR as SNR tends 
to infinity, is 1 irrespective of the number of paths. 

The rest of this paper is organized as follows. We begin with a mathematical description 
of the considered channel model in Section O Section [3] is devoted to channel capacity. Our 
main results are summarized in Section |4j They follow from upper bounds and lower bounds on 
channel capacity, which are derived in Sections [5] and [6l respectively. Section [7] concludes the 
paper with a brief summary and a discussion of our results. 



2 Channel Model 

Let C and N denote the set of complex numbers and the set of positive integers, respectively. We 
consider a discrete-time multipath fading channel whose channel output Yk G C at time k G N 
corresponding to the time-1 through time-fc channel inputs x\, . . . G C is given by 



Y, 



k-l 

e=o 



Xk-e 



k€N. 



(1) 



Here {Zk} models additive noise, and i?l denotes the time-fc gain of the £-ih path. We assume 
that {Zk} is a sequence of independent and identically distributed (IID), zero- mean, variance- 
er 2 , circularly-symmetric, complex Gaussian random variables. For each path £ G No (where No 
denotes the set of nonnegative integers), we assume that {H^\ k G N} is a zero- mean, complex 
stationary process. We denote its variance and its differential entropy rate by 



A r- 

ai = E 



H 



Ml 2 



£G No 



(2) 



and 



ht± lim -h(H[ e \ 

n^oo n 



M% ^N . (3) 
We shall say that the channel has a finite number of paths, if for some finite integer L G No 



Hi 



0, I > L, k G N. 



We assume that ao > 0. We further assume 



and 



sup at < oo 



inf he > — oo, 

tec 



(4) 



(5) 



(6) 



where the set C is defined as C = {£ G No : at > 0}. (When the path gains are Gaussian, 
then the latter condition ([6]) is equivalent to saying that the mean-square error in predicting the 
present path gain from its past is strictly positive, i.e., that the present path gain cannot be 
predicted perfectly from its past.) We finally assume that the processes 



{Hi°\keN},{H^, fcGN} 



(i) 
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are independent ( "uncorrelated scattering"); that they are jointly independent of {Z^}; an< 4 that 
the joint law of 

fceN},^' 1 ' fceN},...) 

does not depend on the input sequence {xt}- We consider a noncoherent channel model where 
neither transmitter nor receiver is cognizant of the realization of {H^\ k G N}, £ G No, but 
both are aware of their law. We do not assume that the path gains are Gaussian. 

3 Channel Capacity 

Let A 1 ^ denote the sequence A m , . . . , A„ . We define the capacity (in nats per channel use) as 

C*(SNR)^ lim -supl(X?;Yf), (7) 

n — >oo il 

where the supremum is over all joint distributions on X\, . . . , X n satisfying the power constraint 

n 

^£e[|A^]<P, (8) 



n 
fe=i 



and where SNR is defined as 



SNR 4 Jl (9) 
a 1 

By Fano's inequality, no rate above C(SNR) is achievable. (See [I] for a definition of an 
achievable rate.) We do not claim that there is a coding theorem associated with ([7]), i.e., that 
C(SNR) is achievable. A coding theorem will hold, for example, if the number of paths is finite, 
and if the processes corresponding to these paths {H^\ k G N}, . . . , {Hj^\ k G N} are jointly 
ergodic, see jS, Thm. 2]. 

The special case of noncoherent frequency-flat fading channels (where we have only one path) 
was studied by Lapidoth and Moser [2J. They showed that if the fading process {H^\ k G N} 
is ergodic, then the capacity satisfies 



SNR 



lim {C(SNR) - loglogSNR} = logir + E logjijf^ - h (10) 



(see [5J Thm. 4.41]), where log(-) denotes the natural logarithm function. Thus, at high SNR, 
the capacity of noncoherent frequency-flat fading channels grows double-logarithmically with 
the SNR. Lapidoth and Moser concluded that communicating over noncoherent frequency-flat 
fading channels at high SNR is extremely power-inefficient, as one should expect to square the 
SNR for every additional bit per channel use0 

In this paper, we show inter alia that communicating over noncoherent multipath fading 
channels at high SNR is not merely power-inefficient, but may be even worse: if the delay 
spread is large in the sense that the sequence {ag} (which describes the variances of the path 
gains) decays exponentially or slower, then capacity is bounded in the SNR. For such channels, 
capacity does not tend to infinity as the SNR tends to infinity. The main results of this paper 
are presented in the following section. 



4 Main Results 

Our main results are a sufficient and a necessary condition on {ag} for C(SNR) to be bounded 
in SNR, as well as a characterization of the capacity pre-loglog when the number of paths is 
finite. 

Note that the capacity of coherent fading channels (where the fading realization is known to the receiver) 
behaves logarithmically with the SNR [B]. Thus in the coherent case it suffices to double the SNR for every 
additional bit per channel use. 
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Theorem 1. Consider the above channel model. Then 

(i) ( Um 2*ti > =► C sup C(SNR)<oo) (11) 

V^oo / \SNR>0 / 

(ii) f lim 7 log— = oo ] =*> ( sup C(SNR) = ooY (12) 

\^->oo £ tt£ / \ SNR>0 / 

where we define a/0 = oo /or every a > and 0/0 = 0. 

Proof. Part (i) is proven in Section 15. 1| and Part (ii) is proven in Sections 16.11 & 16.21 □ 
By noting that 

lim 1+1 = ) =>■ [ lim - log — = 

>oo Q!^ J >oo £ Oil 

we obtain from Theorem [1] the immediate corollary: 
Corollary 2. Consider the above channel model. Then 

(*) f lim^±i>0) => f sup C(SNR)<oo) (13) 

V-kx) a ^ / \SNR>0 / 

(ii) (Um ^±1 = ) ( sup C(SNR) = oo\ (14) 

V^oo a £ J \SNR>0 / 

where we define a/0 = oo for every a > and 0/0 = 0. 
For example, if 

on = e~ l , £ e No, (15) 

then 

lim «?±1 = i > (16) 

£^oo q;^ e 

and it follows from Part (i) of Corollary [5] that the capacity is bounded in the SNR. On the 
other hand, if 

a*=exp(-*"), f£N (17) 

for some k > 1, then 

lim f*?±i = Um exp(r - (£ + 1) K ) - (18) 

and it follows from Part (ii) of Corollary [5] that the capacity is unbounded in the SNR. Roughly 
speaking, we can say that when {cti} decays exponentially or slower, then C(SNR) is bounded 
in SNR, and when {cti} decays faster than exponentially, then C(SNR) is unbounded in SNR. 

The condition on the left-hand side (LHS) of (fi~4l) is surely satisfied if the channel has a finite 
number of paths, as in this case 

H ( k e) =0, £ > L, k e N, 

which implies 

at = 0, I > L and 2£±1 = - A £ > L. 

Q!£ 

Consequently, it follows from Corollary [5] that if the number of paths is finite, then C(SNR) 
is unbounded in SNR. However, for this case the high-SNR behavior of the capacity can be 
characterized more accurately: Theorem [3] ahead shows that if the number of paths is finite, 
then the capacity pre-loglog, defined as 

A = C(SNR) 

SNR^oo log log SNR' v ; 

is 1 irrespective of the number of paths. The pre-loglog in this case is thus the same as for 
frequency- flat fading. 
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Theorem 3. Consider the above channel model. Further assume that the number of paths is 
finite. Then, irrespective of the number of paths, the capacity pre-loglog is given by 



A 



lim 



C*(SNR) 



SNR^oo log log SNR 
Proof. See Section 15.21 for the converse and Sections 16.11 & 



1. 



for the direct part. 



(20) 
□ 



When studying multipath fading channels at low or at moderate SNR, it is often assumed 
that the channel has a finite number of paths, even if the number of paths is in reality infinite. 
This assumption is commonly justified by saying that only the first (L + 1) paths are relevant, 
since the variances of the remaining paths are typically small and hence the influence of these 
paths on the capacity is marginal. As we see from Theorems Q] & El this argument is not valid 
anymore when studying multipath fading channels at high SNR. In fact, when for example the 
sequence of variances {at} decays exponentially, then according to Part (i) of Theorem [T] the 
capacity is bounded in the SNR. However, if we consider only the first (L + 1) paths and set the 
other paths to zero, then it follows from Thcorem[3]that, irrespective of L, the capacity increases 
double-logarithmically with the SNR. Thus, even though the variances of the remaining paths 
ai, £ > L can be made arbitrarily small by choosing L sufficiently large, these paths may have a 
significant influence on the capacity behavior at high SNR. 

The reason why paths with a small variance can affect the capacity behavior is that the 
capacity depends on the variance of the product between the path gains and the transmitted 
signal and not on the variance of the path gains only. Since at high SNR the variance of 
X^l+i Xk-e, might be huge even if the variance of X)fc=L+i ^fe ^ s sman ! the relevance 
of a path is determined not only by its own variance but also by the power available at the 
transmitter. The number of paths that are needed to approximate a multipath channel typically 
depends on the SNR and may grow to infinity as the SNR tends to infinity. 

In order to prove the above results, we derive upper and lower bounds on the capacity. 
Since these bounds may also be of independent interest, we summarize them in the following 
propositions. 

Proposition 4 (Upper Bounds). 

(i) Consider the above channel model. Further assume that for some < p < 1 and some 
< £N 

oti > v and > p, t > Iq. 

at 



Then the capacity C(SNR) is upper bounded by 



2n 2 



C(SNR) < log — ^ - inf (hi - log a*), SNR > 0, 



where 



p = mm 



inj^- 1 



a to 



max <£'«? a.v 



(ii) Consider the above channel model. Further assume that 

oo 

at = a < oo. 

Then 



sN lim {C(SNR) - log log SNR} < 1 + log tt - inf {h e - log a t ) 



Proof. Part (i) is proven in Section [5. 11 and Part (ii) in Section 



(21) 
(22) 

(23) 

(24) 
□ 



5 



For example, if {ae} is a geometric sequence, i.e., 

a e = p\ £e No 

for some < p < 1, and if the path gains are Gaussian and memoryless so 

h e = log(weae), I E N , 
then Part (i) of Proposition H yields 

27T 

C*(SNR) < log — - 1, SNR > 0. (25) 

Vp 

Part (ii) of Proposition Q] combines with (jTUJ) to show that the pre-loglog of a multipath fading 
channel can never be larger than the pre-loglog of a frequency-flat fading channel. This result 
is consistent with the intuition that at high SNR the multipath behavior is detrimental. 

Our last result is a lower bound on the capacity. This bound is the basis for the proof of 
Part (ii) of Theorem Q] and for the direct part of Theorem [3] 

Proposition 5 (Lower Bound). Consider the above channel model. Further assume that 

oo 

ae = a < oo. (26) 
Let L(P) <= N be some positive integer that satisfies 

oo 

a t P<a 2 (27) 

<=L(P)+1 

(typically L(P) depends on V), and let r G N be some arbitrary positive integer that is allowed to 
depend on L(P). Then the capacity C(SNR) is lower bounded by 

C(SNR) > L(p j" + - loglogP 1/T + L{p T ) + - (^E[log|g< 0) | 2 ] -l-21og(yS "+v / ^+2^)Y 

P > 1. (28) 

Proof. See Section O □ 



5 Proofs of the Upper Bounds 

In this section, we establish a proof of Proposition [H which in turn will be used to prove Part (i) 
of Theorem [T] and the converse to Theorem |3J 

Part (i) of Proposition 0] is proven in Section 15.11 and it is demonstrated that Part (i) of 
Theorem [1] follows immediately from this result. Section [5TU proves Part (ii) of Proposition 0J 
This part provides an upper bound on the capacity pre-loglog and will be used later, together 
with a capacity lower bound that is derived in Section [6l to establish Theorem [3] 

5.1 Bounded Capacity 

We provide a proof of Part (i) of Proposition [4] by deriving an upper bound on channel capacity 
that holds under the assumption that for some < p < 1 and some £q € No 

a io >0 and > p, £>e . (29) 

ae 

As this bound is finite for SNR > 0, Part (i) of Theorem [T] follows immediately from Part (i) of 
Proposition d] by noting that if 

lim^±i>0, 

e^oo ae 
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then we can find a < p < 1 and an £ £ N satisfying 

The proof of the desired upper bound is akin to the proof of an upper bound that was derived 
in [7J Sec. 6.1]. (However, [7] studies a channel whose inputs & outputs take value in the set of 
real numbers rather than in C.) It is based on ((Jj) and on an upper bound on il(X?;Yi n ). To 
this end, we begin with the chain rule for mutual information [3] Thm. 2.5.2] 



i i*o 1 n 

-I(X?;Y?) = -£ J (*"5 y *l y ] fc " 1 ) + - E HX^Y?- 1 ). 

k=l k=£ + l 

Each term in the first sum on the right-hand side (RHS) of ([30]) is upper bounded by 



(30) 



l{X? ] Y k \Y*- 1 )<h(Y k )-h[Y k \Y*-\X?,H { ° ) ,H i 



l k ' ' 



,H. 



(fc-i) 



< 



log ^Tre ^a 2 + J2 «< E [l-^fc-il 2 ] U - log (Tea 2 ) 



(31) 



< log ( 1 + sup a £ n SNR ) , 

where the first inequality follows because conditioning cannot increase differential entropy [H 
Thm. 9.6.1]; the second inequality follows from the entropy maximizing property of Gaussian 
random variables [?J Thm. 9.6.5]; and the last inequality follows by upper bounding ag < 
sup £ / gNo ap, I = 0, 1, . . . , k — 1 and from the power constraint (jSJ). 

For k = £o + 1, £q + 2, . . . , n, we upper bound l(X"; YjJ ) using the general upper bound 
for mutual information [2J Thm. 5.1] 

(32) 



I(X;Y) < J D(W(-\x)\\R(-)) dQ(x), 
where -D(-||-) denotes relative entropy, i.e., 



D(Pi\\Po) 



log^&dP! 



dP 



+oo 



if Pi « Po 
otherwise, 



W(- 1 •) is the channel law, Q(-) denotes the distribution on the channel input X, and R(-) is 
any distribution on the output alphabet!! Thus any choice of output distribution R(-) yields an 
upper bound on the mutual information. 



For any given Yf 1 = y\ x , we choose the output distribution R(-) to be of density 



.k-i 



VP 



1 



K 2 \Vk\ l + P\Vk\ 



Vk G 



with 13 = l/(p\y k -e \ 2 ) and 



p = mm < p 



a t 



to 



(33) 



(34) 



max <£'<£ ate 

(If y k -e = 0, then the density (|33|) is undefined. However, this event is of zero probability and 
has therefore no impact on the mutual information Yfe| Yj With this choice 

< p < 1 and pai < ctt+e , I G No. 

and averaging over Y^ 1 , we obtain 



(35) 



Using 



l(X^Y k \Yt l ) < ^E[log|y fc | 2 ] +iE[log(p|r fc _, | 2 )] 



log 1 



\Ykf 



h(Y k \X™,Y*- 1 ) +lo g7 r 2 
h(Y k \X?,Y?- 1 



[log|y fc | 2 ] - iE[log|F fc _, | 2 ] +E[log(p|n_ <0 



p\Y k -to I 2 

2 + l^el 2 )] 



1 ^ 



(36) 



2 For channels with finite input and output alphabets this inequality follows by Tops0e's identity [8]; see also 
[9] Thm. 3.4]. 
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We bound the third and the fourth term in separately. We begin with 



E[io g (p|r fc _, | 2 + |r fe | 2 )] =e 

< E 



E[iog(p|r fe _, | 2 + |r fe | 2 )|^]] 



log(pE[| 



k-£o\ 



xi] + E[im 2 | xi] 



k-Cn-1 



fc-l 



< E 



logUl + ^cr 2 + pai\X k -i - e \ 2 + J2 a A x k- 

(k-t a -l fc-l 
2a 2 + ]T 
1=0 e=o 

I fc-i fc-i 

log] 2a 2 + a £ ,\X k _ e ,\ 2 + J2<*e\Xk-e 

Z'=t 

/ fc-i 

log (T 2 + Y a A X k 



< log 2 + E 



^k-e\ 



(37) 



where the first inequality follows by Jensen's inequality; the subsequent equality follows by 
evaluating the expectations; the next inequality by (|35|) ; the following equality by substituting 
(! — £ + £ - } and the last inequality follows because 



fc-l 



fc-l 



f = (o 



e=o 



Next we derive a lower bound on h (Y k I X™ ,Y ± 1 ) . Let 



and let 



We have 



(38) 
(39) 



h(Y k \X?,Yt l ) >h(Y k 



= h(Y k 



X^,Y^- x ,~K k - x ) 



(40) 



where the inequality follows because conditioning cannot increase differential entropy; and where 
the equality follows because, conditional on (X",H^ _1 ), Y k is independent of Y^ 1 . Let S k be 
defined as 

S k ± {£ = 0, 1, . . . , k - 1 : \x k _ e \ 2 a t > 0}. (41) 
Using the entropy power inequality [H Thm. f6.6.3], and using that the processes 

{iff.kN^fff.kN},... 
are independent and jointly independent of X™, it is shown in Appendix |A~1 that for any given 



'fc-i 



hi Y H k )x k-i + Z k 



X[ l = x?,Hj- 1 



> log Y e 

\ies k 



At--/ 



^(2 fc ) 



(42) 
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We lower bound the differential entropies on the RHS of (j4"2")l as follows. The differential entropies 
in the sum are lower bounded by 

X k ^ = Xk ^,{H^ 



hi U k ' Xk-i 



log (a t \x k -t 



2 ) + h(Ht*\{ 



H, 



k-l 



k ' h> = l 



log a e 



> log (ae \xk-e | 2 ) + inf (he - \ogae) , I S S k 



(43) 



where the equality follows from the behavior of differential entropy under scaling [?J Thm. 9.6.4]; 
and where the inequality follows by the stationarity of the process {H k , k G N}, which implies 
that the differential entropy 



h H, 



cannot be smaller than the differential entropy rate he [H Thms. 4.2.1 & 4.2.2], and by lower 
bounding (he — log ae) by inf eec (he — log ae) (which holds for each £ € S k because S k C C). The 
last differential entropy on the RHS of (|4"2"| is lower bounded by 



h(Z k ) = log(7recr 2 ) > inf (he - \ogae) + log cr 2 , 



(44) 



which follows because conditioning cannot increase differential entropy, and because Gaussian 
random variables maximize differential entropy: 



inf (he - logae) < inf (/i(ff^) - logo*) 



< inf (log(7rea^) — loga^) 
= log(Tre). 

Applying ((43]) & ((44j) to (|32"]). and averaging over X™, yields then 



(45) 



^(Ffclx^rf- 1 ) > E 



log ^ at\X k _ t \ 2 e inU ^ {ht - Xosa ^ +0 -2 e inf <e£ (^-iog« £ ) 

/ fc-1 



log CT 2 +^a/|^fc_ 



£=0 



+ inf (/i£ - loga^) . 



(46) 



Returning to the analysis of (f3"6"]l , we obtain from (|37p and (|4"6")l 



/(Xftn]!?- 1 ) < -E[log|y,| 2 ] - -E[log|y fe _, | 2 ] +log2 + E 



fe-i 



log a 2 + ^a^|AV 



£=0 



log a 2 + ^2 ae\X k -e 



£=0 



- inf (he - loga<>) + log — = 



iE[log|y fc | 2 ] - iE[log|^ fc „, | 2 ] +K, 



where K is dehned as 



a 2tt 2 
K = log — = - inf (h e - loga £ ) . 
VP te£ 



(47) 
(48) 



Applying flJZ]) and (31]) to f30|). we have 

£o 



^^E lo g( 1 + i u P a ^ SNR ) + ^ E (^E[io g |y fe | 2 ] -Je [logins | 2 ] +k 



fc=i 



fe=^o+l 



log 1 + sup n SNR 



n-£ 



E (EtloglFfeH-Efloglr^J 2 ]). (49) 

n fe=«o + l^ ' 
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To show that the RHS of (j4"9")l is bounded in the SNR, we use that, for any sequences {a k } 
and {b k }, 



fc=£ +l fc=n— < +l 



k=£n+l 



Defining 
and 



a k ±E[log\Y k \ 2 ] 



b k ^£[\og\Y k _ tQ \ 2 } 
we have for the first sum on the RHS of (l50l 



(50) 

(51) 
(52) 



^ (a k -b k _ n+2to )= (E[log|n| 2 ] -E[log|n_ n+ , | 



k=n -e +i 



< (logE[|n| 2 ] -E[log|n_ n+£o | 

k=n-t a + l 



fe=n-£ + l 



< logk 2 + supa^nP -E[log|r fe _ n+£o | 2 ] 



fe=n-£ + l 



< y~] logl cr 2 + sup a/nP ) - E [log |Z fe _„ +! j 

1 1 £eN 



4 log ( 1 + sup an n SNR ) + £ 7, 



(53) 



where 7 « 0.577 denotes Euler's constant. Here the first inequality follows by Jensen's inequality; 
the following inequality follows by upper bounding 

fc-i 

E[|n| 2 ] =a 2 + Y / a l E[\X k - l \ 2 ] < a 2 + sup a t n P; 



1=0 



the subsequent inequality follows by noting that, conditional on ^2 i= Q H k _ n+gg X k _ n+ g B _g, 
we have that |Yfc_„ + ^ | 2 is stochastically larger than \Z k - n+ i \ 2 , so 

k-n+lo-l 

H k-n+£ X k-n+e -e 

t=o 



log|r fe _„+^| 2 



> E 



log \Z k - n 



+U>\ 



Z^j H k-n+i X k-n+i a - 



1=0 



from which we obtain the lower bound E [log \Y k ^ n+ g 1 2 ] > E [log \Z k - n+ e 1 2 ] upon averaging 

over X^=o Hj® n+e Xk-n+to-i (see [21 Sec. VI-B] and in particular [21 Lemma 6.2 b)]); and 
the last equality follows by evaluating the expected logarithm of an exponentially distributed 
random variable of mean a 2 , i.e., E [log | Zk- n +>to I 2 ] = 1°S ° 2 ~ 7- 
For the second sum on the RHS of (l50l) we have 



(54) 



J2 (a k -b k+eo )= ]T E[log|y fc | 2 ] ~E[log|n| 2 ] ) =0. 

k=l + l k=t a + l ^ 



Thus applying f50 l - f55|l to |g9j) yields 



~I(X?; Y7 1 ) < — log I 1 + sup at n SNR 

n n 



n-lo £ 

K+ — 7, 

n n 



(55) 



which tends to 



2^ 2 



K = log — =■ — inf (he — logo*/) 

6 ^ c 



as n tends to infinity. This proves Part (i) of Proposition 01 
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5.2 Unbounded Capacity 

We prove Part (ii) of Proposition Q] by deriving an upper bound on capacity that holds under 
the assumption ([26]) . namely, 



ai < oo. 



From this upper bound follows that 



Km {C(SNR) - log log SNR} < oo, 

which in turn shows that the capacity pre-loglog is upper bounded by 

C(SNR) 



lim 



SNR^oo log log SNR 



< 1. 



(56) 



(57) 



This yields the converse to Theorem [3] 

As in Section 15.11 the desired upper bound follows by |(7J) and by deriving an upper bound 
on Y"). To this end, we begin with the chain rule for mutual information 



l(X?;Y?) =J2l(X?;Y k \Y 1 k - X ) 



(58) 



k=l 



and upper bound each summand on the RHS of (fS"5)) using Eq. (27)] 

l(X?; Y k \Y^) < E [log |F fc | 2 ] - h(Y k \X?, Y^ 1 ) + £(l + log E [|y fe | 2 ] - E [log \Y k \ 2 ] ) 

+ lo g r(0 - £log £ + log 7T 

= (i - oe [log |y fe | 2 ] - h(Y k \x?, y*- 1 ) + e(i + log E [lYfel 2 ] ) 
+ io g r(e)-eiog^ + iog7r, 



(59) 



for any £ > 0. Here T(-) denotes the Gamma function. 

We evaluate the terms on the RHS of (|59f individually. We upper bound the first term using 
Jensen's inequality 

E[log|r fc | 2 ] =E[E[log|Y fe | 2 | X*]] 
<E[logE[|n| 2 | Xf]] 



= E log \^T 2 + J2 a f \ x k-t 
The second term was already evaluated in P6"|) 



fe-i 



t.=o 



(60) 



fe-i 



log a 2 +J2 a ?\X 



k-t\ 



t=t) 



hfalX^Yf- 1 ) > E 
and the next term is readily evaluated as 

log E [|F fc | 2 ] = log ( a 2 + ]T a e E [| A fc _,| 2 ] 



+ inf (h e - at) 



(61) 



fc-i 



(62) 



Our choice of £ will satisfy £ < 1 (see ahead). We therefore obtain, upon substituting 
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@BHS3 in ©, 

/(XrjYfel^- 1 ) < (1-OE 



fc-i 



log a 2 +^Q!^|X 



k-e\ 



fe-i 



log a 2 +^a^|X fe _ < 



fc-l 



- inf (he - at) + t [ 1 + log ( a 2 + ^ a*E [|X fc _ £ | 2 ] 



+ io g r(0-eioge + iog7r 

- inf (he - at) 

eec 



k-i 



d l + logU 2 + ^a,E[|X fe _,| 2 ] -E 



fc-i 



log cr 2 + J2 a e\ x k-e 



e=o 



+ i og r(e)-Cioge + iog^ 

< - inf (he - a t ) + logr(£) - £log £ + log tt 
+ qi + log(l + ^a,E[|X fe _,| 2 ] /<7 2 J 



where the last inequality follows by lower bounding E 
We choose 



> log cr 



1 



1 + log(l + a SNR) 



(where a was defined in (|26p V Defining 



*(SNR) 



io g r(0-io g --eiogC 



5=(l+log(l+aSNR)) 



we obtain 

/(X^I^-^-inf (h. 



eec 



x t ) + log(l + log(l + a SNR)) + *(SNR) + logTr 

l + log(l + E^=o^E[|X fe _,| 2 ] /a 2 ) 
+ l + log(l + aSNR) ' 

Using ([66]) in ((58]) yields then 

-l(X?;Yfl < - inf (h e - a e ) + logfl + log(l + a SNR)) + (SNR) + log it 
n tec 



1 + k ELi (l + Eto [|X fc _,| 2 ] 



1 + log (1 + a SNR) 



By Jensen's inequality we have 
fc-i 



n fc-i 



fc=l V £=0 / V fc=l £=0 

< log (1 + a SNR) , 



n 



where the last inequality follows by rewriting the double sum as 

i—k 



^E[\X k f)/a^at, 



k=l 



e=o 



and by upper bounding then ^ t= ^ at < a and using the power constraint 
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Combining and ([57]) with (0, we obtain the upper bound 

C(SNR) < - inf (h e - a e ) + log(l + log(l + a SNR)) + *(SNR) + logTr + 1. (69) 

It follows by 2, Eq. (337)] that 

Jim^ v|/(SNR) = Um{lo g r(0 - log i - £log£} = 0. (70) 

Noting that 

lim |log(l + log(l + a SNR)) - loglogSNR} = 0, 
we obtain from (l69l) and (l70l) the desired result 



gN hm |C(SNR) - log log SNR} < 1 + log tt - inf (h e - a e ) . (71) 

6 Proofs of the Achievability Results 

In Section [6. 11 we derive the lower bound on channel capacity that is presented in Proposition [5l 
This lower bound will be used in Sections l6.2l fc l6~3"l to prove Part (ii) of Theorem Q] and to prove 
the direct part of Theorem [31 respectively. 

6.1 Lower Bound 

To derive the desired lower bound on capacity, we evaluate -^I(X™; Y") for the following distri- 
bution on the inputs {Xk}. 
Let L(P) be such that 

oo 

a f y<cr 2 . (72) 

£=L(P) + 1 

To shorten notation, we shall write in the following L instead of L(P). Let r 6 N be some positive 
integer that possibly depends on L, and let Xf, = (^&(l+t)+i, . . . , -^(6+i)(l+t))- We choose {X;,} 
to be IID with 

Xf, = (0, . . . ,0,X bT+ i, . . . ,X( b+1 ) T ), 



where Xb T +i, ■ ■ ■ , X(h+i) T is a sequence of independent, zero-mean, circularly-symmetric, 
complex random variables with log |JT;, T+ „| 2 being uniformly distributed over the interval 
[log p( y - 1 )/ T , log ? V ' T ] , i.e., for each u = 1,...,t 



log \X bT+ „\ 2 ~ U ( [log p(^y\ log r' T \ 



(Here and throughout this proof we assume that P > 1.) 

Let K = Lf^fJ (where [a\ denotes the largest integer that is less than or equal to a), and let 
Yf, denote the vector (1&(l+t)+i, ■ ■ ■ , Y(b+i)(L+T))- By the chain rule for mutual information we 
have 



I{X?;Y?) ^/(X^Y^ 

= E / ( x ^ Y o _1 i x r i ) 



b=0 

K-1 



>^J(X fc ;Y b ), (73) 



6=0 



where the first inequality follows by restricting the number of observables; and where the last 
inequality follows by restricting the number of observables and by noting that {X;,} is IID. 
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We continue by lower bounding each summand on the RHS of ([75)) . We use again the chain 
rule and that reducing observations cannot increase mutual information to obtain 



I(X&; Y b ) — y^^l(X bT+ „;Y b | 



> 



br+v\ ^6(L+t)+L+w | ^fc T +l 



X 



> 



6t+^; ^6(l+t)+l+ 



0. 



(74) 



where we have additionally used in the last inequality that X bT+ \, . 
Defining 



fc(L+T) + L+y-l 



bT-\-v 



E 



6(L+r) + L+y^b(L+r) + L+ I /-£ + ^h(L+r )+!_+!/ ! 



,X((,_|_i) T are independent. 

(75) 



each summand on the RHS of (|T4"|) can be written as 

^(Xh T+ „; y i ,(L +T ) +L+v ) = I (Xf, T+I ,; H^ +T ^ +l ^ +JJ Xbr +l/ + Wbr+v)- 

A lower bound on (|76[) follows from the following lemma. 



(76) 



Lemma 6. Let the random variables X , H, and W have finite second moments. Assume that 
both X and H are of finite differential entropy. Finally, assume that X is independent of H ; 
that X is independent of W ; and that X^—H^—W forms a Markov chain. Then 



I(X; HX + W)> h(X) - E [log \X\ 2 ] + E [log \H | 2 ] 



log [ire [a H 



o~w 



(77) 



where > and > denote the variances of W and H. (Note that the assumptions 
that X and H have finite second moments and are of finite differential entropy guarantee that 
E[log|X| 2 ] and E [log \H\ 2 ] are finite, see Lemma 6. 7e]. ) 

Proof. See pU Lemma 4] . □ 

It can be easily verified that for the channel model given in Section [2] and for the above 
coding scheme the lemma's conditions are satisfied. We therefore obtain from Lemma [5] 



(0) 



&(L+t)+L+ 1 ^ 6t +^ 



> h(X, 



log|X hT+!/ | 



]n Jir{0) I 2 



log ?re y/a^ 



VE[\W bT+u \ 

|X)T+I/| 



(78) 



Using that the differential entropy of a circularly-symmetric random variable is given by (see 
Eqs. (320) & (316)]) 



h(X bT+u ) = E log | X bT+v | 2 + /i(log|X br+ „| 2 ) +log7r, 



(79) 



and evaluating h(\og \X bT+ „\ 2 ) for our choice of X bT+v , yields for the first two terms on the RHS 

of eg 

h(X br+1/ ) - E[log|X bT+ ,| 2 ] = loglogP 1/T +log^. (80) 

We next upper bound 

E[|WW| 2 ] ^ E[|X b(L+r)+L+ „_ £ | 2 ] 



IX, 



IjT- 



\x bT + v \ 



6(L+-r)+L+f-l r. 

E L LI A KL+r) + L 



+v-t\ 



\XbT + v \ 



IX, 



(81) 
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To this end, we note that for our choice of {X/,} and by the assumption that P > 1, we have 



and 

from which we obtain 



E[|X £ | 2 ]<P, leN, 
E [\X b{L+r)+L+u _ e \ 2 ] < P ( ^ )/r , 1=1,..., L, 

\X bT+ „\ 2 > p ( ^ 1)/t > 1, 



and 



E[|X fc(L+r)+L+ ^| 2 ] < P^ 

E [|^b(L+r) + L+y-£| 2 ] 



1,...,L 



Applying l[84" |) -([86" ll to ([81 ]l yields 
E[|WW| 



<P, * = L + 1 j ... > &(L + t)+L + i/-1. 



(82) 
(83) 

(84) 
(85) 
(86) 



fc(L+r) + L+iy-l 



|-X&t+i/| 



- X! ae + ^2 ae? + cr 2 



=L+1 



< a + V" a £ P + g 2 



«=L+1 



< a + 2cr 2 



(87) 



with a being defined in (f!?6")) . Here the second inequality follows because oti, £ G No and P are 
nonnegative, and the last inequality follows from ([7^1) . 

By combining (J75J with (SO]) & f57[). and by noting that by the stationarity of {H^°\ fceN} 



log Iff, 



(0) 

6(L+r) + L+;y| 



log i?i 



(0)1 2' 



we obtain the lower bound 



(0) 



jj &(L+t)+L+^ <""+ 



^ b r+„ + W bT+u ) > l0gl0gP 1/r + E 



log Hi 



(0)1 2 



21og(ySo"+Va + 2o2) 



Note that the RHS of (|88|) neither depends on v nor on b. We therefore have from (|88|) . (|74|) . 
and (J73J) 

7(X";y™) > K rloglogP 1/r + ktT, (89) 

where we define T as 



T = E 



loglflf^ 2 - 1 - 21og(v^o"+ y/a + 2<r 2 



(90) 



Dividing the RHS of (|89p by n, and computing the limit as n tends to infinity, yields the lower 
bound 

C(SNR) > loglogP 1/r + — ^— T, P>1, (91) 

L + r L + r 

where we have used that linin^oo n/n — 1/(L + t). This proves Proposition [5j 
6.2 Condition for Unbounded Capacity 

We use Proposition [3] to prove Part (ii) of Theorem [TJ In particular, we show that if 



lim — log — =oo, 



(92) 
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then, by cleverly choosing L(P) and r, the lower bound (f2"5| . namely, 



C(SNR) > 



L(P)+r 



log log P 



1/r 



L(P)+T 



T, P > 1 



(where T is defined in ([90)0 , can be made arbitrarily large as SNR tends to infinity. To this end, 
we first note that (|92|) implies that for every < g < 1 we can find an £q G N such that 



By choosing 



L(P) 



at < Q , i> to. 
log(P/q 2 g/(l - g)) 

iog(i/e) 



(93) 



(94) 



(where [a] denotes the smallest integer that is greater than or equal to a) and r = L(P), we 
obtain from (BHD the lower bound 



1 



C(SNR) > - log 



logP 



1. 



io g (p/<r 2 e/(i-e)j 



-T, P>1. 



(95) 



log(l/(?) 

Taking the limit as SNR (and hence also P = c 2 SNR) tends to infinity, yields 

hm C(SNR)>iloglog~ + ~T. 
SNR^oo 2 g 2 



Since this holds for every < g < 1 



sup C(SNR) = oo. 

SNR>0 



(96) 



(97) 



It remains to show that {at} and our choice of L(P) (f94|) satisfy the conditions (|26)l & ((27] 
of Proposition O namely, 

OO OO 

< oo and P < a 2 . 

1=0 fcL(P) + l 

It follows immediately from © and that satisfies the first condition 

OO ^n — 1 OO OO 



on = + < £q su P a t + 5^ 6^ = to sup 



Off 



ten, 



fc^o 



g<= 

l~g 



< oo. 



(98) 



In order to show that L(P) satisfies the second condition (f2"7) , we first note that by 



E «<< E 



g = g 



f 



'+i 



1-g 



, t! > £ - 1. 



(99) 



Since L(P) tends to infinity as P — > oo, it follows that L(P) is greater than (to — 1) for sufficiently 
large P. Furthermore, (|94| implies 



L(P) Q_ 



P < cr 2 



We therefore obtain from and (flUD|) 



V a ,P<g L ( p )-^P<a 2 , 
z — ' 1 — g 



f=L(P)+l 

thus demonstrating that L(P) satisfies (|2"7|) . 



(100) 



(101) 



16 



6.3 The Pre-LogLog 



We use Proposition [5] to prove Theorem [3] To this end, we first note that because the number 
of paths is finite, we have for some L e No 

a e = 0, I > L, (102) 

which implies that 

oo L 

$Z ae = $Z a e < 0-+ 1) sup ag < oo (103) 

and 

oo 

^ c^P = < a 2 . (104) 

e=L+i 

Consequently, it follows from l|28p of Proposition [5] that the capacity is lower bounded by 

C(SNR) > ^— loglogP 1/T + -j-^T, P>1. (105) 

Dividing by loglogSNR, and computing the limit as SNR — > oo, yields 

C(SNR) t , . 

SnrT^oo loglogSNR L~+~r' < 106 > 

where we have used that for any fixed r 



log log P 1 ^ 
lim = 1. 

SNR^oo log log SNR 

The lower bound on the capacity pre-loglog 

C(SNR) ,. C(SNR) , . . 

A = lim i '— > lim i '— > 1 (107 

SNR^oo log log SNR SNR^oo log log SNR 

follows then by letting r tend to infinity. Together with the upper bound A < 1, which was 
derived in Section [521 this proves Theorem [3l 



7 Conclusion 

We studied the high-SNR behavior of the capacity of noncoherent multipath fading channels. We 
demonstrated that, depending on the decay rate of the sequence {at}, capacity may be bounded 
or unbounded in the SNR. We further showed that if the number of paths is finite, then at 
high SNR capacity grows double-logarithmically with the SNR, and the capacity pre-loglog is 
irrespective of the number of paths. The picture that emerges is as follows: 

• If the sequence of variances {ae} decays exponentially or slower, then capacity is bounded 
in the SNR. 

• If the sequence of variances {at} decays faster than exponentially, then capacity is un- 
bounded in the SNR. 

• If the number of paths is finite, then the capacity pre-loglog is equal to 1, irrespective of 
the number of paths. 

The conclusions that can be drawn from these results are twofold. First, multipath channels 
with an infinite number of paths and multipath channels with a finite number of paths have 
in general completely different capacity behaviors at high SNR. Indeed, at high SNR, if the 
number of paths is finite, then capacity grows double-logarithmically with the SNR, whereas 
if the number of paths is infinite, then capacity may even be bounded in the SNR. Thus, 
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while for low or for moderate SNR it might be reasonable to approximate a multipath channel 
with infinitely many paths by a multipath channel with only a finite number paths, this is not 
reasonable when the SNR tends to infinity. The number of paths that are needed to approximate 
a multipath channel typically depends on the SNR and may grow to infinity as the SNR tends 
to infinity. 

Second, the above results indicate that the high-SNR behavior of the capacity of multipath 
fading channels depends critically on the assumed channel model. Thus when studying such 
channels at high SNR, the channel modeling is crucial, as slight changes in the channel model 
might lead to completely different capacity results. 
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A Appendix to Section 15.11 



To prove 



we lower bound 

/k-1 



h I ^k Xk-e + Zk 



X 7 ? = ^,H^- 1 = hj 



k-i 



for a given \i\ 1 , and average then the result over 1 . Let TL k denote the set 

Hk = {H ( k e \£ = 0,...,k-l:a e = 0}. 



(108) 



(109) 



We have 



tk-l 



\i=0 



h[Y,Hl e) X k _ e + Z k 

s-l 

\e=o 
\ees k 



k-i 



X{ 1 ^x^H^ 1 = h^ 1 



+ Z k 



z k 



>io g Yl e 

\ees k 



(110) 



where S k is defined in (I41|) . Here the first inequality follows because conditioning cannot increase 
differential entropy; the following equality follows because differential entropy is invariant under 
deterministic translation [4, Thm. 9.6.3], and because the terms where x k -i = do not contribute 
to the sum; and the last inequality follows by the entropy power inequality [4j Thm. 16.6.3], and 
because the processes 

{flf.teNMflf'.teN},... 

are independent. (Note that, for a given H^ _1 = h^ _1 , the conditional entropies on the RHS 
of (IllOj) are possibly infinite. However, by (J6j) this event is of zero probability and is therefore 
immaterial to (|110p when averaged over H^ _1 .) 

Since the processes of the path gains are independent and jointly independent of X", we 
can compute the expectation of (|110p over H^" 1 by averaging (|110p first over [h\ , . . . , H^}^, 

then averaging the result over (H^, . . . , Hj^Zi), and so on. To lower bound the individual 
expectations, we note that the function 



f(x)=log(e x + (), xe 



(111) 
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is convex for all £ > 0. Thus, by setting for each £' = 0, . . . , k — 1 



£<£' 



(112) 



it follows from Jensen's inequality 



log I{£'eS fc }< 



k x k-t> 



i j fc'=i 

>log(l{£'eS fc }e 



A' 



+ £' = 0,...,A;-1, (113) 



where I{-} denotes the indicator function, i.e., 
I {statement} = 

Averaging (|110|) over H^ -1 , and employing ()113[) to compute this average, yields thus 



1 if statement is true 
if statement is false. 



(114) 



>k-l 



h I ^ Xk-e + Zk 



>l0g J2 6 

\ieSk 



(115) 



This proves the lower bound (142 
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